a bitter pill

a bitter pill (for somebody) (to swallow)

​a fact or an event that is unpleasant and difficult to accept

The election defeat was a bitter pill for the party to swallow.